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Abstract 

The general linear group GL{n,K.) over a field K contains a particularly prominent 
subgroup U{n,K), consisting of all the upper triangular unipotent elements. In this 
paper we are interested in the case when IK is the finite field ¥q, and our goal is to 
better understand the representation theory of U{n,¥q). The complete classification 
of the complex irreducible representations of this group has long been known to be 
a difficult task. The orbit method of Kirillov, famous for its success when K has 
characteristic 0, is a natural source of intuition and conjectures, but in our case 
the relation between coadjoint orbits and complex representations is still a mystery. 
Here we introduce a natural variant of the orbit method, in which the central role 
is played by certain clusters of coadjoint orbits. This "method of clusters" leads to 
the construction of a subring in the representation ring of U {n, ¥g) that is rich in 
structure but pleasantly comprehensible. The cluster method also has many of the 
major features one would expect from the philosophy of orbit method. 

Introduction 

Over 40 years ago A. A. Kirillov [32] created the method of orbits, which not only 
gives beautifully compact and complete answers, all in terms of coadjoint orbits, to 
the main questions of representation theory for nilpotent Lie groups, but also has 
become a powerful tool and a source of intuition for the study of other groups of Lie 
type. 
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The upper triangular unipotent group U{n) has been the ideal example for which 
the orbit method works perfectly. However, there remains a tantalizing open question: 
The classification of the coadjoint orbits. 

The present work starts with two simple observations. First, the coadjoint action 
of U{n, ¥g) on the dual space of its Lie algebra can be extended to a double action. 
Second, the group algebra of U{n,¥g) has a natural basis, the Fourier basis. The 
double action and the Fourier basis are connected through the regular representation 
of U{n, ¥q) on its group algebra, and this connection leads to a rich theory of cluster 
characters [explain more] with many of the major features one would expect from the 
philosophy of orbit method. These features include an one-to-one correspondence be- 
tween the cluster characters and the coadjoint clusters, a character formula expressing 
the character in terms of the cluster, and equivalence between character operations 
(tensor product, induction and restriction) and cluster operations. A remarkable new 
feature is the canonical decomposition of the regular representation into a direct sum 
of cluster modules. 

The collection of all cluster characters form an orthogonal basis for the C-linear 
space of cluster functions on U{n,¥g). The collection of all Z- linear combinations of 
cluster characters form a subring in the representation ring of U{n, ¥q). This subring 
is generated by the primary cluster characters, and each cluster character has a unique 
primary decomposition into a tensor product of primary cluster characters. 

Section [S] is inspired by a paper of G.I. Lehrer 03]- Lehrer was interested in the 
discrete series character of U{n,¥g), which is by definition the common restriction of 
the discrete series characters of GL{n, ¥q). He derived a tensor product decomposition 
of this character, and then further decomposed each factor into a multiplicity-free 
sum of irreducible components. We noticed that these irreducible components are 
precisely the primary cluster characters of our theory. This led us to the discovery 
of an explicit decomposition of the discrete series character into a sum of cluster 
characters. Moreover, we were able to construct a realization of the discrete series 
representation as a canonical submodule in the regular representation of U{n,¥q). 

To close this introduction we draw the reader's attention to the series of papers on 
the representation theory of U (n, F^) , by C. A.M. Andre [H [21 |3l SJ |5l |6l [7] . Throughout 
his papers Andre makes the assumption p > n in order to have the benefit of a well- 
behaved exponential map. In this case an one-to-one correspondence between the 
irreducible characters and the coadjoint orbits was established by Kazhdan. Andre 
defines certain "basic sums" of coadjoint orbits, and studies the characters associated 
to the orbit sums via the above correspondence. Note that here the popular mode of 
thinking is to go from to its algebraic closure, so that the coadjoint orbits can be 
treated as geometric objects. It transpired that the orbit sums of Andre are precisely 
the coadjoint clusters, and the characters in his work are the cluster characters. 
The main results of Andre agree well with our own theory, while his approach is an 
impressive tour de force in algebraic geometry. 
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1 Basic notations 



Let f/(n,]K) be the group of upper triangular unipotent matrices over a field K, 
u(n, K) be the K-algebra of upper triangular nilpotent matrices over K, and u*(n, K) 
be the dual K-linear space of u(n, K). An element in u*(n, K) is a K-hnear map from 
u{n, K) to K. 

There are three natural ways for U{n, K) to act on u(n, K). These are defined by: 

left action X ^ 9 ■ X 
right action X i-)- X ■ g 
adjoint action X i->- g ■ X ■ g~^ 

where g G U{n, IK) and X G u(n, IK). The dot ( ■ ) means multiplication of matrices. 
The left and right actions commute, and together they give a double action of U (n, K) 
on u(n, K). The adjoint orbit C{X) and the adjoint cluster K{X) of X are 

C{X) = {g-X-g-': geU{n,K)}, 
K{X) = {g-X-g': g, g' e U{n,K)} , 

with C{X) C K{X). Each adjoint cluster is a union of adjoint orbits. 
Correspondingly we have the following actions of U{n, K) on u*(n, K): 

left action {g * \){X) = \{X ■ g) 
right action {\*g){X) = \{g ■ X) 
coadjoint action ^^{^) = ^9^^ ' ^ ' 9) 

where g and X are as above, and A G u*(n, K). The left and right actions commute, 
and together they give a double action of U {n, K) on u*(n, IK). Moreover 

g * X* g~^ — X^. 

The coadjoint orbit fl{X) and the coadjoint cluster ^(A) of A are 

Q(A) = {g*X*g-': geU{n,K)}, 
*(A) = {g*X*g': g,g'eU{n,K)}, 

with Q{X) C ^(A). Each coadjoint cluster is a union of coadjoint orbits. 

There is a natural correspondence between adjoint orbits in u(n, K) and conjugacy 
classes in U {n, K) via the map X I -\- X , hy virtue of the identity I -\- g ■ X ■ g~^ — 
g-{I+X) -g'^. Thus each adjoint cluster naturally corresponds to a union of conjugacy 
classes, which we refer to as a conjugacy cluster. 

Wc use C[[/(n,IK)], C[u(n, K)] and C[u*(n,IK)] to denote the respective spaces of 
complex- valued functions on U{n,K), u(n, K) and u*(n, IK). 
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2 Cluster modules and their characters 

Let ^ be a fixed non-trivial homomorphism from the additive group of to the 
multiphcative group of C The Fourier basis for C[U{n,¥q)] consists of the elements 

{^;(A) : Aeu*(n,F,)} 

defined by 

^(A): g ^ e[\{g-I)]. 

This is an orthonormal basis for C[U{n,¥q)] as a C-finear space. Note that 

^(Ai + A2) = v(Xi)-v(X2). (2.1) 

Consider the regular representation of U{n,¥g) on C[U{n,Fq)] given by the left 
action. For v e C[U (n, F^)] the left action oi g e U (n, Fg) sends v to g*v defined by 

g*v: g' ^ v{g'g). 

In a sense, one can say that the representation theory of a finite group is all about 
decomposing the regular representation. In the case of f/(n, Fg), it is particularly 
fruitful to consider the regular representation in terms of the Fourier basis {v{\)}. 

Proposition 2.1. 

g^[v{X)] = [v{X){g)]-v{g*X). 

Proof. The function v{\) sends g' to 9[\{g' — /)] , so 51 * [^{^)\ sends g' to 9[\{g'g — I)] . 
Now 

e[\{g'g-I)] = e[\{g'g-g + g-I)] 

= e[\{g - I)] . e[X{{g' - I) . g)] 
= ^[A(^-7)]-^[(^*A)(^'-7)] 
= v{X){g).v{g*X){g'). 

This gives the proposition. □ 

The first of many consequences of this proposition is that for any orbit L in 
u*(n, Fg) under the left action of t/(n, Fg), the C-linear subspace in C[t/(n, Fg)] 
spanned by the set 

{v{\): AeL} 

is a submodule of the regular representation of ?7(n, Fg). We denote this submodule 
by V{L), and let x{L) be the trace of C/(n, Fg) on V{L). The dimension of xi^) is 
equal to the size of L, and 

L 
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where the sum is over all orbits in u*{n, ¥q) under the left action of U{n, ¥g). Clearly 
V{L) is generated by v{X) for any A G L, so we can write V{X) = V{L) and xW = 
x{L). In this notation we have V{X) = V{g * A). 

Definition. We will refer to the modules V^(A) as cluster modules and the characters 
x(A) as cluster characters. 

Remark. The notation x(0) naturally stands for the trivial character, which of course 
is the cluster character associated to A = 0. 

Proposition 2.2. The cluster modules V{X) and V{X * g) are isomorphic. 

Proof. The isomorphism is given by the right action of U{n,¥q) on C[U{n,¥q)]. For 
V G C[U{n, ¥g)] the right action by g sends v to v * g defined by 

v*g: g' i-^ v{gg'). 

Similar to the case of the left action in Proposition 12. we have 

[v{X)]*g=[v{X){g)]-v{X*g), 

so the right action by g sends V{X) to V{X * g). □ 

Corollary 2.3. The cluster character x(A) only depends on the coadjoint cluster \i/ 
to which X belongs. We can therefore write x(\E') = 

Theorem 2.4. The regular character of U{n,¥q) is equal to the sum 

4-degxW '^^"^^ 

over the collection of coadjoint clusters in u*{n,¥q). 

Proof. For each cluster let ^(^1/) be the submodule in C[U{n,¥q)] spanned by the 
set 

{v{X): Ag^} 
The dimension of K(\E') is |\E'|, and 

C[U{n,¥q)] = m). 

By Proposition 12.21 V(\E') is a direct sum of isomorphic copies of cluster modules, 
each copy corresponds to an orbit in under the left action of U{n,¥q). The trace 
of U{n,¥q) on each copy is equal to cind the number of such copies must be 

l^l/deg We therefore have the decomposition in the theorem. □ 
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Let L be an orbit in \l/ under the left action of f/(n, Fg). By Proposition 12.11 

xm{9)= E ^(^)(^)' (2.2) 

g*A=A 

where the sum is over all elements of L that are fixed under the left action by g. The 
following theorem gives the character formula one would expect from the philosophy 
of orbit method (see Kirillov j37i Conjecture 2.2.1]): 

Theorem 2.5. 

Proof. We can write equation (12. 2p as 

xm{9) = Y.^<9*^). v{X)).viX){g), 
agl 

or in other words 

^(*)(^) = E E [^(^ * ^ - ^)(^') ■ ^(^)(^)] ' 

where the second sum is over all elements of U{n, ¥q). The expression in the brackets 
can be simplified: 

v{g * X - X){g') ■ v{X){g) 
= 9[{g*X-X){g'-I) + X{g-I)] 
= e[X{g'g-g)-X{g' -I) + X{g-I)] 
= 0[X{g'g-g')] 
= 9[{X*g'){g-I)], 

so 

If A runs through all elements of L and g' runs through all elements of U (n, F^), then 
X* g' will run through the elements of each with multiplicity 



|[/(n,: 




)l- 


\L\ 




1^1 





so we have 

I ' Ae* 
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Finally, since \L\ = degx(^), we obtain 

□ 

The character formula looks particularly elegant when we express it in terms of 
the Fourier basis: 

X-W = ^^-E"W (2-3) 

' ' AG* 

Essentially, x(^) is obtained by averaging over the subset { f (A) : A G } of the 
basis. Note that the regular character of f/(n, Fg) is equal to the sum 

A 

taken over the entire basis. From this point of view, the decomposition in Theorem 
12.41 is completely transparent. 

Corollary 2.6. x{^){9) = x(^)(fi'') whenever g and g' belong to the same conjugacy 
cluster. 

Corollary 2.7. The interwining number between two cluster characters x(^) (^i^'d 
is zero unless \E'' = in which case 

[degx(^)]' 
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Definition. We say a complex-valued function on U{n, Fg) is a cluster function if it 
is constant over each conjugacy cluster. 

In Section [3] we will classify the adjoint clusters in u(n, K) and the coadjoint 
clusters in u*(n, K), and see that the two kinds of clusters are equal in number when 
IK = Fg. As a consequence, we have the following intrinsic characterization of the 
cluster characters: 

Corollary 2.8. The collection of all cluster characters form an orthogonal basis for 
the C-linear space of cluster functions on U{n,¥q). 

3 Adjoint clusters and coadjoint clusters 

In the first two parts of this section we classify the adjoint clusters in u(n, K) and 
the coadjoint clusters in u*(n, K), where IK is an arbitrary field. We then study 
various important aspects of the coadjoint clusters: Section [3731 defines two numerical 
invariants of coadjoint clusters, which correspond (when IK = Fg) to the degree and the 
self- interwining number of cluster characters (see Section E]). Section 123] introduces 
a primary decomposition for coadjoint clusters, which will be used (when IK = Fg) to 
derive a corresponding primary decomposition for cluster characters (see Section |6]). 
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3.1 Classification of adjoint clusters 

Notation. For 1 < i < j < n let Cij be the matrix whose only non-zero entry is the 
(i, j)-entry, with value 1. The collection 

{eij : I <i < j <n} 

form a K-linear basis for u(n, K). We denote the dual basis in u*(n, K) by 

{Sij : 1 <i < j <n} 

so that 

where X e u(n, K) and the (i, j)-entry of X. 

The left and right actions of U (n, K) on u(n, K) are special kinds of row and column 
operations, respectively. Each element of U {n, K) can be written as a product 

(/ + aij ■ Cij) 

l<i<j<n 

where aij G IK and the factors are arranged in a suitable order. Left action by 
/ + aij ■ Cij corresponds to the row operation which adds aij times the j-th row to 
the i-th row. A general left action is a sequence of such row operations. Similarly, 
right action by / + aij • Cij corresponds to the column operation which adds aij times 
the i-th column to the j-th column, and a general right action is a sequence of such 
column operations. 

Definition. We say X e u(n, K) is an adjoint template if it has at most one non-zero 
entry in each row and each column. Let 7"(n, K) denote the collection of adjoint 
templates in u(n, K). 

Theorem 3.1. Each adjoint cluster in u{n, IK) contains one and only one element in 
Tin, IK) . The adjoint clusters are therefore indexed by the adjoint templates. 

Proof. To reduce an arbitrary element in u{n,K) to some element in T{n,K), we 
proceed column by column, from left to right. Suppose we have successfully reduced 
the first k columns, so that no two non-zero entries in the first k columns belong 
to the same row nor the same column. We now look at the {k + l)-th column. By 
a suitable column operation we can eliminate from this column each non-zero entry 
which shares the same row as another non-zero entry to the left. These column 
operations arc guaranteed not to interfere with each other since none of the first k 
columns contains more than one non-zero entry. From the remaining non-zero entries 
in the {k + l)-th column we can eliminate all but the bottom one (if there is one 
at all) by a sequence of row operations. We are thus done with this column. The 
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process may continue for the remaining columns, until we end up with an element in 
r{n,K). 

We next show that no two adjoint templates belong to the same adjoint cluster. 
For an element X in u(n, K), let rank(i, j, X) be the rank of the matrix 

Xki • eki . 

i<k<l<j 

If X and X' belong to the same adjoint cluster, then rank(i, j, X) — rank(i, j, X') for 
any i and j. This implies that if moreover X and X' are both in T(n, K), then the 
non-zero entries of X and X' must have exactly the same positions. To show that 
X = X', take g and g' in U {n, K) such that g ■ X = X' ■ g' . The non-zero entries in 
X and X' have the same values as the entries at corresponding positions in g ■ X and 
X' ■ g', respectively, and this means X = X'. □ 



3.2 Classification of coadjoint clusters 

Notation. It is convenient to introduce a bijective K- linear map from u*(n, K) to 
u(n, K), given by 

A ^ e(A) = ^i^a) ■ ^ij ■ 

l<i<j<n 

In particular, e(£y) = e^-. The inverse map is 

X H- e{X) = ^ Xij ■ Eij . 

l<i<j<n 

In particular, e{eij) — e^. 

The left and right actions of U{n,K) on u*(n, K) can be described in terms of 
{cij} and {Sij}: 



{I + ttij ■ eij) * Eki = 



Eki * (/ + aij ■ eij) 



Ski + ttij ■ Eki, iil^ j and k < i; 

Eki, otherwise. 

Eki + CLij ■ Eji, iik^i and I > j; 

Eki, otherwise. 



Left action by I + aij - eij on A e u*(n, K) corresponds to a restricted column operation 
on e(A), which adds to each entry to the right of the diagonal in the i-th column Uij 
times the entry to its right in the j-th column. Similarly, right action by I + aij-Cij on 
A corresponds to a restricted row operation on e(A), which adds to each entry above 
the diagonal in the j-th row aij times the entry above it in the i-th row. 
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Definition. For A G u*(?2, K) the support of A, denoted by supp(A), is the set of 
positions (i, j) such that A(ejj) 7^ 0. In other words, A is supported at the positions 
of the non-zero entries of e(A). 

Definition. We say A G u*(n, K) is a coadjoint template if supp(A) contains at most 
one position in each row and each column. Let T*(n,K) denote the collection of 
coadjoint templates in u*(n, K). 

Remark. By definition, A is in T*(n, K) if and only if e(A) is in T(n, K). 

Theorem 3.2. Each coadjoint cluster in u*(n, K) contains one and only one element 
in T*(n,K). The coadjoint clusters are therefore indexed by the coadjoint templates. 

Proof. For A G u*(n, K) we apply restricted row and column operations on e(A) to 
reduce it to some element in T(n, K). This can be done if we proceed column by 
column, from right to left, in the manner described in the proof of Theorem 13. but 
replace "left" by "right" and "bottom" by "top" in the recipe. 

We now show that no two coadjoint templates belong to the same coadjoint cluster. 
For an element A in u*(n, K), let rank(i, j. A) be the rank of the matrix 

A(eH) ■ Cki 

k<i<j<l 

If A and A' belong to the same coadjoint cluster, then rank(z, j. A) = rank(i, j. A') for 
any i and j. This implies that if moreover A and A' are both in T*(n, K), then they 
must have exactly the same support. To show that A = A', take g and g' in U{n,K.) 
such that g * X = X' * g'. The non-zero entries in e(A) and e(A') have the same values 
as the entries at corresponding positions in e{g * A) and e(A' * g'), respectively, which 
means e(A) = e(A'), and A = A'. □ 

3.3 Two numerical invariants of coadjoint clusters 

To each element of u*(n,]K) we will now associate two numerical values that remain 
invariant under the double action of U{n, K). 

Notation. For A G u*(n,K), Let L{X) and -R(A) be the respective orbits of A under 
the left and right actions of f/(ri,]K). Define 

L(A) = L{X)-X, 
R{X) = R{X)-X. 

It is easy to see that L{X) and -R(A) are K-linear subspaces of u*(n, K). By definition, 
A' is an element of L{X) if we can find Y G u{n, K) such that A'(X) = X{XY) for all 
X G u(n, K). Similarly, A' is an element of -R(A) if we can find Y G u{n, K) such that 
A'(X) = X{YX) for all X G u(n, K). 
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Proposition 3.3. Suppose r G T*{n, K) . Then A G L{t) if and only if every position 
in supp{X) lies to the left of some position in supper). Similarly, A G R{t) if and 
only if every position in supp{X) lies below some position in supper). Consequently, 
dim L(r) = dim i?(r). 

Proposition 3.4. For A G u*{n,K), the dimensions of L{X), R{X) and L{X) fl -R(A) 
only depend on the coadjoint cluster \& to which X belongs. Moreover dimL(A) = 
dim^(A). 

Proof. It is easy to verify the following relations: 

L{X *g) = L{X) *g, L{g * X) = g * L{X) = L{X) , 

R(g^\)=g^ R(X) , _R(A *g) = R{X) *g = R{X) . 

As a consequence, the dimensions of L{X), R{X) and L{X) ni?(A) are invariant under 
the double action of f/(n, K), so they are characteristics of the coadjoint cluster \l/ 
to which A belongs. Let r be the coadjoint template in By Proposition 13.3^ 
dim L( A) = dim L(r) = dim R{t) = dim ^( A) . □ 

Definition. We define the dimension index d{X) to be the dimension of L{X) and 
R{X), and define the interwining index i{X) to be the dimension of the intersection 
L(A) n ^(A). By Proposition El we can write c?(\l>) = d{X) and 2(\1>) = i(A). 

It is rather easy to compute and from the coadjoint template in 

Proposition 13.31 says that if r G T*{n,K) then d^r) and i^r) can be determined 
from supp(r) by simply counting various kinds of positions above the diagonal. To 
compute d{r) we just count the number of positions (i, j) such that {i',j) G supp(r) 
for some i' < i, or equivalently, we can count the number of positions {i,j) such that 
G supp(r) for some j' > j. In other words, (i(r) is equal to the total distance 
from its support to the second diagonal (the diagonal right above the main diagonal). 
In particular, (i(r) is zero if supp(r) is contained in the second diagonal. To compute 
i(r) we count the number of positions such that there is simultaneously some 
i' < i with G supp(r) and some j' > j with G supp(r). A more visual 

way to obtain i(r) is to consider the three positions and as forming 

a L-shaped hook, as in the following diagram: 

t 

Here the corner position {i,j) is above the diagonal, while the two arrows each points 
to a position in supp(r). Since no two such hooks can share the same corner position, 
to obtain i(r) we only need to count the number of such corners. 
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3.4 Primary decomposition of coadjoint clusters 

For any Ai and A2 in u*(r;,,K) we clearly have 

^(Ai + A2) c ^(Ai) + ^(A2) = { a; + a;, : (A;, A'2) e ^(Ai) X ^(As) }. 

We will see that if two coadjoint templates ti and T2 in T*{n,K) are supported in 
different rows and different columns then \E'(ri + T2) = ^E'(ti) + ^(r2). 

Notation. For 1 < i < j < n we let Sij denote the coadjoint cluster in u*(n, K) that 
contains Eij. 

Definition. We say a coadjoint cluster in u*(ra,K) is primary if it is the multiple of 
some Sij by a non-zero element in K. 

Theorem 13.61 will show that any coadjoint cluster is equal to a sum of primary 
coadjoint clusters. 

Lemma 3.5. For A G u*(n,K), if supp{X) does not contain any position in the i-th 
row nor the j-th column, then the coadjoint cluster "^IX+a-Sij) is equal to '${X)+a-Sij. 

Proof. The statement is trivial when a = 0, so assume a 7^ 0. The elements of a ■ £ij 
are of the form 

^ ■ ^ij + ■ £kj + ■ Sii + a ^ ■ ■ a'l ■ Eki 

i<k<j i<l<j i<k<l<j 

where and a'l are elements in K. The condition on supp(A) makes it possible to 
bring A + a ■ Sij to 

X + a- eij+ ^ Ofc ■ Ekj + a'l ■ Ea + ^ a"^ ■ ak ■ a'l ■ Eki 

i<k<j i<l<j i<k<l<j 

through a double action of U{n, K), so we see that X + a -Sij is contained in the cluster 
\E'(A + a ■ Eij). For any A' G \E'(A) we can bring X + a ■ Sij to X' + a ■ Sij through a 
double action, so A' + a ■ Sij is also in \E'(A + a ■ Eij). The entire sum \E'(A) + a ■ Sij is 
therefore contained in \Ef(A + a ■ Eij). Finally, the double action is linear, so the sum 
is closed under the double action, and must be equal to \Ef(A + a ■ Eij). □ 

Theorem 3.6. For any r G T*{n,K), 

l<i<j<n 

Proof. We proceed by induction on the size of supp(r). Suppose T(eki) is non-zero 
for some k and I. Put t' = t — T{eki) ■ Eki, then r' is again an element of T*(n, K), 
with a smaller-sized support than r, so we can assume that 

l<i<j<n 
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Now supp(r') does not contain any position in the k-th row nor the l-th column, so 
by Lemma 13.51 



$(r) = ^{T') + Tieki)-Ski 



l<i<j<n 



□ 



Corollary 3.7. If ti and T2 in T*(n, K) are supported in different rows and different 
columns then \E'(ri + T2) = ^(ti) + \E'(t2). 

4 The number of cluster characters 

Cluster characters naturally correspond to coadjoint clusters, while conjugacy clusters 
naturally correspond to adjoint clusters. From Theorems 13 . 1 1 and 13 . 2 1 we see that the 
same set of combinatorial data naturally index both the cluster characters and the 
conjugacy clusters. This is analogous to the fact that the partitions of n index both 
the irreducible characters and the conjugacy classes of the symmetric group Sn- 

The number B{n,q) of cluster characters can be calculated by enumerating the 
elements in T{n,¥q). For example 



In general we have the following recurrence relation, which shows that B{n, q) is a 
polynomial version of the Bell numbers. 

Theorem 4.1. B{n,q) is determined by the recurrence relation 



with B{0,q) = l. 

5 The degree and the self-interwining number 

In this section we express the degree and the self-interwining number of a cluster 
character x(^) iii terms of the dimension index (i(\E') and the interwining index i(\E') 
introduced in Section [3731 

We will need a well-known fact, stated in the following lemma: 



B{l,q) 
B{2,q) 
B{3,q) 
B{4,q) 



1, 

l + 3(g 
l + 6(g 



l) + 7(g-l)2 + (g-l)l 
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Lemma 5.1. Let G and H be finite groups. Let S be a finite set on which G has a 
left action and H has a right action. Then for any element s of S , 



GsH 



\Gs\ 


■ \sH\ 


\Gs 


nsH\ 



Theorem 5.2. For a coadjoint cluster \l/ in u*{n, ¥q), the cluster character x(^) has 
degree q^^'^^ and self-interwining number q'^^^\ The size of is g^c^l*)-*!*). 

Proof. Let A G In the notations of Section [3^ the lemma above says that 

|L(A)|-|i?(A)| |L(A)|-|i?(A)| 
' ~ |L(A)ni?(A)| ~ |L(A)n^(A)| ~ 

The degree of x(^) is equal to the size of L{X), so 

degxW = |L(A)| = |L(A)| = g'^W. 

By Corollary 12.71 we have 

□ 

Corollary 5.3. x(^) ^■5 irreducible if and only if i{^) is zero. 
The character formula in equation (12. 3 p now becomes 

;^(M/)=g^(*MW.^^(A). (5.1) 
AG* 

We can also restate Theorem 12.41 

Corollary 5.4. The regular character of U{n,¥q) is equal to the sum 
over the collection of coadjoint clusters in u*(n, Fg). 

6 Primary decomposition of cluster characters 

In this section we use the primary decomposition for coadjoint clusters established in 
Section [23] to derive a corresponding decomposition for cluster characters. 
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Definition. We say a cluster character is primary if it is associated to a primary 
coadjoint cluster. By definition, x(a ■ Sij) is primary when a is any non-zero element 
of Fg. By Corollary 15.31 the primary cluster characters are irreducible. 

We now show that each cluster character can be decomposed into a tensor product 
of primary cluster characters. 

Theorem 6.1. For t G r*(n,Fg), 

l<j<j<n 

Proof. Write "^ijir) = r^Cij) ■ £ij and Xij{'^) = xi'T'i^ij) ' ^ij)- The character formula 
in equation 12.31 says 

. ^ degx(r) ^-^ 

' ^ AG*(r) 

X^Ar) = ^-(7^- L -(^)- (6-2) 



It is easy to verify from Theorem 15.21 that 

degxM = n degXii(r), (6.3) 

l<i<j<n 
l<i<j<n 

From Theorem 13.61 we know that each element A of "^{t) can be decomposed into a 
sum 

A = ^ Xij 

l<i<j<n 

where Xij belongs to \l/jj(r). li X' = g* X* g' then each such decomposition of A gives 
a corresponding decomposition of A': 

A' = 9* >^ij * a' 

l<i<j<n 

SO the number of such decompositions is the same for any element of ^E'(t). We see 
from (16. 4p that this number must be q^^'^\ By equation (12. ip each decomposition of 
A gives a corresponding decomposition of v{X): 

v{x)= n ^i^v) 
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so 



g^(^) . y: -(A) = n 

Ae<I'(T) l<i<j<n 



(6.5) 



The theorem now follows if we combine fl6.ip - fl6.5l) . □ 

Corollary 6.2. Ifri andT2 in T*{n,Wq) are supported in different rows and different 
columns then ® x{'T2) = + ^2)- 

7 Tensor products of cluster characters 

We know from Section [2] that cluster characters are cluster functions. The tensor 
product of two cluster characters is again a cluster function, and so by Corollary 12.81 
it can be decomposed into a C-linear combination of cluster characters. We will see in 
this section that the coefficients are always non-negative integers, so that the product 
is actually equal to a sum of cluster characters. 

For coadjoint clusters \E'i, and ^ in u*(n, F^), the character formula in equation 
(15. ip gives the following expression for the interwining number between x{^i)®x{^2) 
and x(^)- 

Proposition 7.1. 

„i{*l)+j(*2)+j(*) 

where Cl'^i, "$2, ^) is the size of the set 

{ (Ai, A2) G ^1 X $2 I Ai + A2G^}. 
Corollary 7.2. For coadjoint clusters \E'i and in- u*{n,¥q), 

where the sum is over all coadjoint clusters in u*{n,¥g). 

CoroUarv 17.21 says that the tensor product x{'^i)^x{'^2) is a linear combination of 
cluster characters with non- negative rational coefficients. We will see in Theorem 17.81 
that the coefficients are in fact integers. In general it is a non-trivial task to determine 
the coefficients, with the tricky part being the computation of C(\E'i, ^^2? The 
following is a very special case: 

Corollary 7.3. The multiplicity o/x(0) in x(\E') x(^E'') is zero unless \E'' = — \E', in 

which case the multiplicity is g**-*-* . 
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From Section E] we know that each cluster character can be decomposed into a 
tensor product of primary cluster characters. In order to understand tensor products 
of cluster characters in general, we shall first consider the case when both cluster 
characters involved are primary. 

Notation. For I < i < j < n and a G we use x{hj:(^) cin alternative notation 
for x(a ■ Eij). Note that xihJ) 0) is the trivial character for any i and j. 

The next four propositions give the decomposition of x{hjj(^) ® xi^'ij'i^)- We 
assume ah ^ 0. There are the following cases to consider: 

(1) z^z', jV/, 

(2) I ^ i\ J = f, 

(3) t = t', J ^ f, 

(4) z = z', J =f,a + bj^ 0, 

(5) z = i', J =f,a + b = 0. 

Case (1) is directly covered by Corollary 16.21 The product is again a cluster 
character. 

In case (2), the positions (i, j) and are in the same column. It appears that 

the factor associated to the higher position dominates the product, the other factor 
dissolves away. This case can be reduced to case (1): 

Proposition 7.4. If ab ^ and i' > i then a) ® is equal to 



i'<j'<j CT^O 



Case (3) is similar to case (2). The two positions and {i,j') are in the same 
row, the factor associated to the position on the right dominates, the other factor 
dissolves away, and the case can be reduced to case (1): 

Proposition 7.5. If ab and j' < j then j, a.) ® xihj'yb) is equal to 



i<i'<j' c^O 



In cases (4) and (5), the two positions coincide, and the factors play symmetric 
roles. Case (4) can be reduced to case (2) or case (3), while case (5) can be directly 
reduced to case (1). 
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Proposition 7.6. If ah ^ Q and a + 6 7^ then xih j, d) ® x{h h b) is equal to 



Xii,j,a + b) 



i<i'<j cj^O 



this is also equal to 



X{i,j,a + h) (g) 

Proposition 7.7. If a then x{i,j,ci) ® xihh ~'^) equal to 



j<j'<j c^O 



i<i'<j b^O 



i<j'<j c^O 



Theorem 7.8. The tensor product of any finite number of cluster characters is equal 
to a linear combination of cluster characters with non-negative integer multiplicities. 



Proof. We use induction on the total degree of the tensor product. By Theorem l6.1l we 
can write the product in the form xi^i) ®x(''"2) ® ■ ■ ■ , where each factor is associated to 
a primary coadjoint template, if all the templates involved are supported in different 
rows and different columns then Corollary 16.21 savs the product is equal to the cluster 
character associated to ri + r2 + ■ ■ ■ . If any two of the templates are supported in 
the same row or column, with one (or both) supported on the second diagonal, then 
the corresponding characters can be combined by applying the following special cases 
of Propositions 17.4117771 If i < j then z + 1, a) ® xihj + ^) = xihj + 1; b) and 
XUJ + l,a) ® xihj + = xihJ + 1,^); moreover xih^ + l,a) O xih^ + = 
x{i, "^ + 1, a+b). After this, if we can still find two of the templates with supports in the 
same row or column, but both above the second diagonal, then we can decompose the 
product of the corresponding characters according to Propositions I7.4tl7.7l This will 
break the original product into pieces, each with a smaller degree, and the induction 
works. □ 



Remark. Theorem 17.81 says that the collection of all Z-linear combinations of cluster 
characters form a subring in the representation ring of U{n,¥q). This subring has a 
rather pleasant structure: it is generated by the primary cluster characters, with the 
relations given in Propositions I7.4H7.7I 



8 The discrete series character 

Let A(n, K) be the collection of elements A in u*(n, K) such that supp(A) contains 
at least one position in each of the first n — 1 rows. It is easy to check that A{n, K) 
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is closed under the left action of U{n,K) on u*{n,K). Thus by Proposition 12.11 the 
subspace in C[U{n,Wq)] spanned by the set 



{v{X): XeA{n,¥,)} 

is a submodule of the regular representation of U{n,¥q). We denote this submodule 
by D{n, Fg), and let 6{n, ¥g) be the trace of U (n, Fg) on D{n, Fg). The cluster module 
V(\) is contained in D{n,¥q) for every A G A(n,Fg), and D{n,¥q) is a direct sum of 
cluster modules. The character 6{n, ¥q) is therefore a sum of cluster characters. 

Theorem 18.21 will show that 6{n,¥q) is equal to the character of the restriction to 
U{n, ¥q) of any irreducible discrete series representation of GL{n, ¥q) (see p31 Section 
3]). We therefore refer to S{n,¥q) as the discrete series character of U{n,¥q). 

Proposition 8.1. Suppose A G u*(r7,,K) and X G T(n, K), and write g = I + X . 
Then g * X = X if and only if supp{X) contains no position above any non-zero entry 
ofX. 

Theorem 8.2. The discrete series character 6 = 6{n,¥q) has value 

5{g) = (-l)^(^) . _ 1) . (g2 _ 1) . . . (^n-l-.(.) _ 1) 

at g E U{n,¥q), where r{g) is the rank of g — I . 

Proof. Write g = I + X . Since 5 is a sum of cluster characters, it must be a cluster 
function, therefore (since the right-hand side of the formula is a cluster function in 
the first place) we can assume X G T{n,¥q). By Proposition 12.11 

g*X=X 

where the sum is over all A G A(?t,, ¥q) that are fixed under the left action by g. 

For 1 < < n — 1 let Ak{X) be the collection of elements A in u*(n, ¥q) such that 
supp(A) contains at least one position in the k-th row, and no position in any other 
row or above any non-zero entry of X. By Proposition 18.11 an element A in A(n, F^) 
that is fixed under the left action by g can be written (uniquely) as a sum 



A 



k 



X, 



where A^ G Afc(X). We can therefore write 



s{9) = n 



n 



AeAfc(X) 



U) 



AGAfe{X) 
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Since X G T(n, F^) each row of X contains at most one non-zero entry. By a simple 
computation we find 



6'[A(X)] 1 if tlie A;-tli row of X is zero; 

7— f , 1—1, if the k-th. row of X is non-: 



(8.2) 

zero. 



AeAfc(X) 

From X G T(n, Fg) it is also easy to conclude that 

|Afc(X)|=g"-^-'"=(^)-l, (8.3) 

where bk{X) is the number of non- zero entries of X below the k-th row. Moreover, 
the rank of X is equal to the number of its non-zero entries. The theorem now follows 
if we combine ([HII])-(IH3])- □ 

We next compute the multiplicity of each cluster character in the discrete series 
character. We will need the following modified version of Lemma 15.11 



Lemma 8.3. Let G and H he finite groups. Let S he a finite set on which G has a 
left action and H has a right action. Let S' he a suhset of S which is closed under 
the action of G. Then for any element s of S, 

\GsHr}S'\ 



\Gs 




sH n S'\ 


1 


Gs 


nsH 





For T G T*{n,K) let R{t) be as in Section [331 For 1 < A; < n - 1 let Rk{T) be 
the collection of elements A G -R(t) such that supp(A) contains only positions (if any) 
in the k-th row. Clearly Rkir) is a subspace of -R(t), and 

R{r) = 0i?fc(r). 

k 

Let d{k,T) be the dimension of Rk{T). Then 

d{r) = 5^rf(A:,r). (8.4) 



By Proposition 13. 3[ d{k,T) is equal to the number of positions (z,j) G supp(r) such 
that i < k < j. 

Theorem 8.4. The discrete series character 6{n,¥q) is equal to a sum of cluster 
characters. For r G T*(n, Fg) the multiplicity of xi.^) in S{n,¥g) is equal to 



d{r)-i{T) . 

keZ{T) 



qd(k,T) 



where Z{t) is the set of indices 1 < k < n — 1 such that supp{t) contains no position 
in the k-th row. 



20 



Proof. The fact that 5{n, Fg) is equal to a sum of cluster characters is explained 
after its definition and already used in the proof of Theorem 18.21 Let ^I/(t) be the 
coadjoint cluster of r, and let L{t) and R{t) be the respective orbits of r under the 
left and right actions of U{n,¥q). The multiplicity of x{'^) ^(^jl^g) is equal to the 
number of orbits in '^{r) fl A(?T,,Fq) under the left action, and this number is equal 
to |^(r) n A(n,Fg)|/|L(r)|. By Lemma[ 



|^(r) n A(n,Fq 



|L(r)|-|i?(r)nA(n,F, 
|L(r)ni?(r)| 



so the multiphcity is equal to \R{t) fl A(n,Fg)|/|L(r) ni?(r)|. We know from Section 
13.31 that \L{t) n R{t)\ = q^^'^\ so the theorem is reduced to 



\R{T)nA{n,Wg)\=q- 



n 

fcGZ(T) 



.5) 



We can write each element A G R{t) as a sum 



where A^ G Rk{T). Then A G A(n,Fg) if and only if Ajt 7^ for every k G .Z'(r). Thus 
the number of elements in R{t) fl A(r2,Fq) is equal to 



n (/('^-^ - 1) 



and by (18. 4p this is equal to 



q''^'- n 



1 - 



id(k,T) 



SO we obtain (18. 5p . 

Remark. It is interesting to compare Theorem 18.41 with Corollary 15.41 

We say r G T*(ti,K) is degenerate if e(r) can be written in block diagonal form 



□ 



e r 



e(ri) 



with Ti G T*{k, K) and r2 G T*{n — k, K) for some 1 < A; < n — 1 . Equivalently, r is 
degenerate if d{k, r) = for some k G 2'(r). 

Corollary 8.5. For t G T*(n, Fg) i/ie cluster character x('r) ^■^ contained in the 
discrete series character if and only if r is non-degenerate. 
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9 Appendix 

9.1 The character formula 

Arias-Castro, Diaconis and Stanley [SI Theorem 2.2] and Andre [6l Theorem 3] gave 
a remarkable closed form formula for the cluster characters. We can not resist the 
temptation to give this formula a new formulation and a new proof in the framework 
of this paper. 

For a coadjoint template r G T*(n, K) and an adjoint template X G T(n, K), 
define the index i{X, r) to be the number of F-shaped hooks as in the following 
diagram: 

i 

where the right arrow points to a position in supp(r) while the down arrow points to 
the position of a non-zero entry in X. 

Theorem 9.1. For a coadjoint template r G T*(n, F^) and an adjoint template X G 
T(n, ¥g), the cluster character x(r) has the following value at I + X : 

{qd{T)-'i{x,T) . ^|^-;r(x)], if X has no non-zero entry below or 
to the left of any position in supper); 
0, otherwise. 

Proof. Write g = I + X, and let L{t) be the orbit of r under the left action of 
U{n,¥g). Equation ([22]) says 

x{r){g) = J^'^Wig) = 

A A 

where the sum is over all elements A G L(r) which are fixed under the left action of 
g. There are three cases to consider: 

(1) X has a non-zero entry below some position in supp(r). 

(2) X has a non-zero entry to the left of some position in supp(r). 

(3) X has no non-zero entry below or to the left of any position in supp(r). 

In case (1), Propositions 13.31 and 18. ll imply that no A G L{t) can satisfy g * X = X, 
thus x(r)((7) = 0. In cases (2) and (3), by the same two propositions we can write 

X{r){g) = e[r{X)].J2mX)i 

A 
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where the sum is over those A G u*(n,Fg) such that supp(A) contains only positions 
(if any) to the left of supp(r) and no position above any no n- zero entry of X. Note 
that the number of A's with this property is precisely It is straightforward 

to verify that the sum is zero in case (2) and in case (3). So we obtain the 

formula. □ 

9.2 Supercharacter theory for finite groups 

A supercharacter theory for a finite group G (as introduced by Diaconis and Isaacs 
in [13]) is defined by a collection /C of non-empty subsets in G and a collection X of 
complex-valued functions on G, with the following properties: 

(1) The members of /C (called superclasses) are mutually disjoint, each is invariant 
under conjugation by G, and their union is equal to G. 

(2) The members of X (called supercharacters) are mutually orthogonal, each is the 
character of a complex linear representation of G, and their sum is equal to the 
regular character of G. 

(3) Each supercharacter is constant on each superclass. 

(4) \X\ = |/C|. 

The cluster method introduced in this paper leads to a specific supercharacter 
theory for U{n,¥q), in which the superclasses are the conjugacy clusters and the 
supercharacters are (up to constant multiples) the cluster characters. Clearly super- 
character theory has a much broader scope. It is an interesting project to find other 
natural instances of supercharacter theory. 
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